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INSPECTION OF PRINTED CIRCUIT BOARDS USING COLOR 
p prnrw THE INVENTION 
The present invention is related to the field of inspection of patterned surfaces, such as 

pnntedcircuitboa^ 

as conductor oxidation, using color. 

n ftc-rammr T the tnvention 

One widely used method for inspection of W printed circuit boards having 
metalized portions and, unmetalized, laminate portions is to: 

(a) iUu^inate the board with Hght which appears to come fiom a wide range of angular 



10 directions; 




[py image mc ___.■■■ ■ ■■■ —» '«■ f v * 

(c) define the metalized portions from the image of the board; and 

(d) determine defects in metalization on the board by one or more of comparison of the 

i^ewithastar^ 

15 determine if it meets the rules. _ T „ „ t „. A ,« MS . 

^,_»_,,_____M_i*^.-^-»^*^ 

5,619,429; 5.77W and 5.774,573, *. di_los__ of «bicb _. incorporated 1— >* 



One of the patens in mrttog this con>r__on is the deu_nir_Sonof _g_b«t»_a 
. ar_s covered by co__*» . » board and area, wUhou. 

,___, _____ e_p fe US Men, *g___ * *— - **" 

.Lp— »_* » ___» — *• - ° f — » 

.*____. _.._«_, __. taag. the *o_d uolizing a color _ __**. 

contrast _««_ the conductor, and __. *om *i* the «___»!--»- -«-*- 

M _ r «_by_^««BEb*^"^^ B ^ te ^ to, T^ 
above referenced US Pa_nt 5,524,. 52 genera** one or more differ im a8_ e_h based on a 

difierent liter 10 emphasize different _at_iafcs_» as gold copper, etc. 

US P__t 5,4_,«_, the disclosure of «hich U incorporated by refe-ce, ___, . 
3, region in RGB space that __acter_es a conductor and a region in RGB S * MIC **^ 
_,,___ a ^PixeUa^cl*^ 
regions contains their RGB values. 
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While ideally, the board should consist of only two types of areas, namely metal and 
bare substrate, unfortunately the metalization on a board is sometimes oxidized. Furthermore, 
several types of oxidation and various levels of severity of oxidation exist, making it difficult 
to determine criteria for reliably identifying oxidation. 

Since oxidation is a widespread phenomena in printed circuit board manufacture, 
especially when me boards have been in storage for a considerable period of time and/or have 
been stored under less than ideal conditions, it would be useful to be able to reliably detenrnne 
areas of oxidation on printed circuit boards. Such identification could be useful, for example, 
in avoiding classification of such areas as containing defects. 
Q OF THE INVENTION 

In a broad aspect of the invention, the present invention determines the presence of 
oxide on a conductor on a printed circuit board from an image of the printed circuit board. 

In accordance with some preferred embodiments of the invention, color characteristics 
of light reflected from the surface of a printed dn*}^***** *********** 
,5 an oxidized conductor. The method of the present invention may be used in any rmagmg 
system in which images at multiple colors are attruired. 

According to one broad aspect of the present invention, the presence of an oxide (or 
another definable aspect ofme pixeObde^ennmed by comparing me color ch^ 
suspect pixel with the color characteristics of either the metalization or laminate portions, 

20 preferably, the metal portions. 

According to a second broad aspect of the present invention, the presence of an oxide 
(or another definable aspect of the image) is determined by comparing the color components of 
a suspect pixel utilizing a normalizing scale based on the color characteristics of either the 
metalization or laminate portions, preferably, the metal portions. 
25 According to a third broad aspect of the present invention, the presence of an oxide is 

determined by first finding a region of the color space which is characteristic of oxide and then 
determining if the color values of a pixel is within this region. 

In accordance with one aspect of some preferred embodiments of the invention, the 
determination of an oxide is made without directly excluding the presence of a laminate. In 
30 addition, in some preferred embodiments of the invention, only "interior- pixels (that is pixels 
not near an edge) are classified as oxide. 

In a preferred embodiment of the invention each of the color scales for RGB is first 
normalized between a low fight level and the reflection from fine (unoxidized) copper. 
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P^ W ,« K - <b * te ^ i ss«t«a fc - En y te v* a bovcz H oana*e.co B » te .er^ 

for 8 bit quantification of light level. 

fc , peered enu»diment of the inventa, » H- ^8 » "* **» » "* 

te^M level is d«er»ined not to be an oxide. For outer pixels, fc r which not ^ of^ 

to * M of other coto If ft. - <~M> Iw . is grea« than bo* th. g«a 

pttvata* » HM ccmbtatfons of ch»ac*ris»cs may be lor deUmmtng *. 

presence of other oxide types- ^ . . 

^pr^en*"^"^ 
ievek of the laminate. 

Similar comparisons Me useful for dtfennmiug other types of oxidation andfat 

such as gold, tin-tend, or double tteatcd copper conductors, cyanide ester, polynud or teflon 
laminate, photoresist residues or dust 
^Lisfcusprovi^ 
method of analysis of a printed circuit board comprising: 
> gCTeratmg m image of me lted circuit board; and 

determining the presence of an oxide from an analysis of the image. 

. . 0 f m oxide is made without determimng 

Preferably, determination of the presence 01 an omuc 

whether the pixel is a laminate pixeL 

MHfe genenmng • image concise, generating . pixelated .nag. tavmg 
s brighb.es, values for each pixel ^de-nining the preset of the of an oxide compnses 

** m *,^«*o*m~^»*»*~ m ' , * m - ,., 

Preferably, generating an image comprises gen^.p^of^o**^ 



30 




itfeacbfi^^ 

h^pixel/ 



4eenani'a;blue';ir4^^ . . , , 

^' S^d^ennintf m »f *. P««« - - -» * i °*° m * > m ***°™ 
consiocraoon based on ajnghh^ value ^ ajngtejoter. Preferably the color is red »d 
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pixels havmgaredbri^^ fo>m considexationas , 

|pe ing anoxia* Preferably, the color is red and wherein pixels having a red value above a 
given value are eliminated ftojnjconad^pnjs being, an oxide. 

InTprefer^rnbodiment of the invention, determination of the presence of an oxide 

5 includes eliminate pixels ^^ 

level of two colorjL Preferably; th> twacolots are red and gre^and whaem, the. pixel ^ 
Eliminated if its red brightness value compared to that of copper is less than its green 
brightness value compared to copper. Preferably, the two colors are red and blue and wherem 
the pixel is eliminated if its red brightness value compared to that of copper is less than ,ts blue 

10 brightness value compared to copper. 

In a preferred embodiment of the invention, tetemrination of the presence of an oxide 
includes eliminating pixels from consideration based on an analysis of the brightness levels of 
three colors. 

hi a preferred embodiment of the invention, determination of the presence of an oxide 
15 includes eliminating pixels from consideration based on a comparison between the brightness 

tevei of ^mmmmm^m^m^ a * eUmiMted 60111 

consideration as an oxide when its color brightness values have a Mahalanobis distance greater 
than a given value from the mean values of the brightness values for copper. Preferably, the 
given value for the Mahalanobis distance is between 4 and 8, more preferably, about 6. 
M In a preferred embodiment of the invention, the determination of the presence of an 

oxide is made based on_ajdgh^^ 
hrightaessvalues characteristic of copper. 
Preferably, the method includes: 
determining a color gamut characteristic of the oxide; and 
25 comparing the color values of apixel to the determined gamut of values to determine if 

the pixel is an oxide. 

There is further provided, in accordance with a preferred embodiment of the invention, 
a method of multi-color image processing, comprising: 
generating a pluraMtj^^ 
30 wavelength ranges ; 

deterrriining gradient values in the image; and 

analyzing the multi-color images to determine characteristics of the object, 
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I„ preferred embodimfflls of the invention, me regions ot mgn gram 

^vennon ^Ul be more cfcady undcmood *om me Mowing de.cnp.on of w» 

to a preferred enfcodimen. of me hwenuon, . prmted cncni. be*rd <PCB) - 

nominated by mum-waveiengm «*» - » ' " " T*2 

STtl — * " ,»»e*.e to ar, imagmg sys^ m 

^ncanon ffled *me .5, .998. me dUrfosm. of »hKh is 

preset ofLwn^, mree cotor images, name* B. O end B m-ge. are gene** 
~ .■■ ■ jt p^/n.98/00285 niters are used to reduce any croswver of eolois 

^rXdtp in *e determine a set-np h 

ofmterior.^pbcela.edgepixeUand^l-mt^prxds. 

F ir«, the brighmes. of me inmninabon a* the camera »>d AA> paramos- 

» Ju^daHc^ofionl^ 

or ^Jbffi '^ SiSS'a ^ This — . . - 
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auft^c). the **« .f «b i. jsasftutafca-u- «• -yBSS" •* 

Wttojs** Ottxr MM -* metofs of deSntog such fluids may to w* 
instead of the "low-sure" threshold. 

Tie mxTsSin. the set-up U to I«oduc a 3-D Mstogo.. of the colon.. f all ««n«enor 



U6Ai i»*v^ — r * . 



Z ^CI) ^ _ (Ar -i } 2 

£ ^TI) * (AT-D ^ C^" 1 ) 

This matrix is mverted to fom^ 

m a preferred eS^t^^e invention, the following rules are applied to image 
15 pixels in a PC board under test to determine if a pixel is oxidized. 

1) if thepixelis at astrong gradient (fore^le.ttisanedge^itismtcl^ 

and is not marked as an oxide; 

2) if is Mabalaoobis diaance (as defined below) from the mean value of copper pads 

is to. thau s«ne gh« » h «* - ™* ««- ^ »«*«° al » rt4<nd8 - 
20 wim 6 bemg a preferred value; , ._ , 

3) if the red pixel value is less than the low-sure threshold for red, it rs not clashed as 

an oxide (it is definitely laminate); 

4) optionally, if red is less than green for a pixel, it is not classified as an oxide; 

5) opuonaU7,ifredisless^ 

25 q optionaUy, if the red value is greater^ 

not classified as an oxide. 

The Mahalanobis distance for a pixel is detenmned by forming a vector and pre- 
multiplying the inverted covariance matrix by the vector and then post-multiplying the product 
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by the transpose of the vector. The scalar that results from this "modified inner product- of the 
vector is the square of the Mahalanobis distance . 

A preferred algorithm for detenruning if a pixel is at a strong gradient 0-e., it is 
considered to be an edge pixel and thus not subject to the above analysis) is: 
5 Let I[x,y] be the gray level value of the red image at location (x,y). 
To calculate if the pixel at location (x,y) is an edge pixel: 

Let s = ceo(I[x-2,y] Jlx-Uyl^yyix+l^x+iy]) 
io + ceo(Ilx,y-2] J[x,y-1] J[x,y]J[x,y+l]^2]) 

+ ced0lx-2,y-2] fr^W^^ 1 ^ 1 ^S 5 ^ 
+C edOTx-2,v+2y[x-l,v+lM 

where the functions ceoO and cedO are by the corirputer program 
15 fragment below. 

Tien if s 12, the pixel at (x,y) is an edge pixeL 

> typedef unsigned char uchar; 

> static int sst[4][4] = { {1,2, 2, 2}, {2,-1, 2, 2), 

> {2,2,0,0}, {2,2,0,0}}; 

> 

>intf(intd) 
25 > { 

> return (abs(d) <4 ? 0 : (afas(d) <8 ? 1 : 

> (abs(d)<12?2:(abs(d)<16?3: 

> (aos(d)<24?4:(abs(d)<36?5: 

> (abs(d)<128?6:7)))))))*(d<0?-l:l); 

30 >} 

> void ht(float dl, float d2, int *s, float *v) 
>{ 

> *v=0375*dl+0.125»d2; 

35 > 

> if(tabs(*v)<03) 

> •s = (rabs(dl)<0.1)?2:3; 

> else { 

> *s = (*v>0)?0:l; 

40 > } 

> *v=fabs(*v); 

>} 
> 

>intct(intd[4]) 

45 >{ 

> ints,sl,s2; 

> float vl,v2, ret; 

> int t, v; 

7 
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> 

> ht(-4[l],-<i[0],&sl,&vl); 

> htCd[2],d[3],&s2,&v2); 

> 

5 > ret = (vl+v2+l)/2 ; 

> if (ret > 3) 

> ret =3; 

> if(ret<-3) 

> ret =-3; 
10 > v = (int) ret ; 

> 

> s = sst[sl][s2]; 
> 

> if(s=2){ 

15 > if(fabs(vl)>2||iabs(v2)>2) 

> t = 4; 

> else 

> t=0; 

> } 
20 > else 

> t = 0; 
> 

> return t; 
>> 

25 Jintceo(ucharg0,uctogl,ud^g2,ucharg3,ucharg4) 
>{ 

> intd[4]; 
> 

30 > d[0]=f(gl-gO); 

> d[l]=f(g2-gl); 

> d[2] = f(g3-g2); 

> d[3] = f[g4-g3); 

> return ct(d); 
35 >} 

> int ced(uchar gO, uchar gl, uchar g2, uchar g3, uchar g4) 
>{ 

> intd[4]; 

40 > 

> d[0] = f«gl-g0ysqrt(2)); 

> d[l] = f((g2-giysqrt(2)); 

> d[21 = f((g3-g2)/sqrt(2)); 

> d[3] = f((g4-g3ysqrt(2)); 
45 > return ct(d); 



^ space charctfens* of . +- i— * %»*^ ^^^^ 
daemon may be '-rtflaBa9HMMRMM"l» 
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range, in color space, of the images. During testing, the color values of teat pixels are 
Lcom^to ^vluTOthl^ ^^^^tfthe values are within the region, the pixel 
ftSSTi an oxide. Op^on^^S^ W^^^S^S W 
classification as oxides. While have been used, in the past, tod^e^e me^ 

5 andl^in^ th^ have not been used to determine the presence of oxide and have not been 
^^conjunction with gradient information. Furthermore, this method is easily adapted to 
testing for other types of oxide and even to the presence of dust on conductors. 

One preferred use of the information determined by the above described method is in 
avoiding the classification oxide or dust pixels as faults in a printed circuit board. Since these 

10 pixels gene^J-aJ^E^^ 

be classified as lanunate by iKmiial th^^ 

difficulty in determining edges near oxide. Thus, when the above method determines that a 
pixel is oxide, it is, for the purposes of a fault detenm^on program, defmed as a metal paeL 
The present invention has been described in conjunction with preferred, non-lnmtmg, 
,5 embodiments thereof. It should be understood that variations on these embodiments, within the 
scope of the invention, as defined by the following claims, will occur to persons of skill in the 
art In the following claims, where the words "comprising,- comprises," including- or 
"includes- are used these words mean that me apparatus or method includes the followmg 
structure or steps, but may (but need not) include other structure or steps. 
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CLAIMS 



1. A method of analysis of a printed circuit board comprising: 
generating an image of the printed circuit board; and 

5 determining the presence of an oxide from an analysis of the image. 

2. A method according to claim 1 wherein detennination of the presence of an oxide is 
made without determining whether the pixel is a laminate pixel. 

10 3. A method according to claim I or claim 2 wherein generating an image comprises 
generating a pixelated image having brightness values for each pixel and wherein determining 
the presence of the of an oxide comprises detenmning the presence of the oxide responsive to 
the brightness values. 



15 



20 



25 



4 A method according to claim 1 or claim 2 wherein generamig an^ta^roinprises 
4. A meinoa accoiau* s^m^^^^^ 



:^ lit ^f imai ^^ a iadiffcrcntc 0 lor i 



5. A method according to claim 4 wherein the plurality of images comprises a red, a green 
and a blue image. 



6 A method according to claim 4 or claim 5 wherein detenriination of the presence of an 



oxide includes eliininating pixels from consideration based onpbngWpes^yahje^a;"' 



30 



7. A method according to claim 6 wherein the color is red and wherein pixels having a red 
brightness level below a given value are ehminated from consideration as being an oxide. 

8. A method according to claim 6 or claim 7 wherein the color is red and wherein pixels 
having a red value above a given vahie are ehminated from consideration as being an oxide. 



10 
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brightness Ijgffp"^®^- 
, 10 Am^»«o^»cW m 9^ta WO col OTa re^andgr Kn a»d W he^n 
0. Pixd b efeninated if » red bnghd«. vab. comp««o » M of coop- U t« th» «s 
green brightness value compared to copper. 

U A method according to claim 9 or claim 10 wherein the two colors an, red and blue and 
10 wherein the pixel is eliminated if its red brightness value compared to that of copper * less 
man its blue brightness value compared to copper. 

oride includes elimmating pixels from consideration based on an analysis of the brightness 
15 levels of three colors. 

13 Ame^acc^gtoanyo^ 

oxide includes elinunating pixels from consideration based on a comparison between the 
brightness level of three colors wifli brighmess levels for copper. 



20 



25 



30 



14 A^.^o.dingBd^M'^*^ 

oride wher. its color bright ***** I— a Mahatoobis grea« .han a given valoe 

ftom the mean values of me brigtoe» values for copper. 

15. A^-^*^"^*^^*****" 1 **'"' 

is between 4 and 8. 

is about 6. 

„ Ameu^accc^loanyofcbto2^ 

mmd ae b ^ basdonjudsSP^^ 
brightness vah^es characteristic ofcopgen 
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18. A method according to any of claim 4, 5 or 12 and comprising: 

comparing ^oto^ah^of apixel to the detennined gamut of values to determine if 
S the pixel is an oxide. 

19. Amethodofmulu-<»lOTunageiTO 

generating a^uraity of images of an object, said images being acquired at different 



10 P^^^|^^^phiesm1heimage;and 

analyzing the multi-color images to determine characteristics of the object, 
wherein regions of to""^ at or high gradients are analyzed differently from 
other regions of the image. 

15 jo. A method according to claim 19 wherein the regions of high gradient are transition 
regions. 

21 . A method according to claim 19 or claim 20 wherein the regions of high gradient are 
edge regions. 

20 

22. A method according to any of claims 19-21 wherein the regions of high gradient are 
excluded from analysis. 

23. A method according to any of claims 19-22 wherein the regions o^high^adient 
25 include edges between conductors and laminate. — 



24. 



A method according to any of claims 19-23 wherein the object is a printed cnrcuit 
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